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ON  RELIABILITY  INFERENCE 
by 

E.  L.  Pugh 


1.  INTRODUCTION 

An  important  aspect  of  any  system  is  its  reliability,  that  is,  its 
probability  of  successful  operation.  However,  such  a  probability,  R,  is  never 
known  exactly  in  practice  but  may  only  be  approximated  by  an  estimate,  6,  based 
on  either  a  subjective  probability  analysis  or  on  an  analysis  of  actual  failure 

/s 

history  of  the  system.  Tlie  accuracy  of  the  estimate  R  would  therefore  appear 

to  be  at  least  as  important  a  consideration  as  R  itself,  since  it  is  ^  and  not 

R  which  is  used  in  any  systems  analysis.  This  is  especially  true  for  a  purchaser 

of  a  system  as  reflected  in  current  military  contract  specifications.  If  the 

estimate  R  is  based  on  failure  history,  its  accuracy  can  be  precisely  quantified 

in  the  form  of  "confidence";  this  paper  is  concerned  with  such  quantification 

under  various  assumptions  regarding  the  failure  law  (including  the  case  of  no 

assumption).  Moreover,  for  a  given  failure  history,  a  "confidence  relation" 

may  be  established  which  gives  the  confidence  of  the  statement;  "The  reliability 

is  at  least  R^",  for  every  R^,  0  <  R^  <  1.  Thus,  in  addition  to  considering  the 

best  estimate  R  and  Its  confidence,  the  systems  analyst  may  wish  to  compute  a 

value  R^  such  that  the  true  reliability  is  at  least  R^  with  a  very  high  confidence. 

The  value  R*  could  then  be  used  as  a  lower  bound  on  R  for  a  maximum  cost  or 
o 

risk  study.  The  tenhs  "reliability,  "  ''best  estimate,  "  and  "confidence  relation" 
will  now  be  made  mathematically  precise. 
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Let  =  1  -  F(t)  be  the  complementary  distribution  function  of  a  non¬ 

negative  random  variable,  T,  known  as  the  "time  to  failure"  of  a  given  system. 

Let  t  be  a  positive  number  known  as  the  "mission  time"  of  the  system, 
m 

Reliability,  R,  is  defined  as  the  probability  that  the  system  survives  the 
mission  time:. 


R  =  P{T  >  t  )  =  F  (t  ) 
m  c  m' 


(1) 


By  a  best  point  estimate  for  R,  we  shall  mean  a  minimum-variance,  unbiased 
estimate.  By  a  confidence  relation,  depending  on  a  statistic  H,  we  shall  mean 
a  real  valued  function,  C^(r),  0  <  r  <  1,  having  the  following  property:  for 
any  observed  value  |  of  H,  and  any  r,  [r,  l]  is  a  100  C^(r)%  confidence  interval 
for  R.  Thus,  based  on  the  observed  value  g  of  one  says  for  any  r,  0  <  r  <  1: 

the  confidence  that  R  >  r  is  C^(r).  The  function  C^(r)  is  derived  from  a  "pivotal 
quantity,"  i.  e.  ,  a  statistic  whose  distribution  is  independent  of  R.  However,  it 
is  of  interest  to  note  that  in  the  cases  studied: 


C^(r)  =  G(|;r) 


(2) 


where  G(|;r)  is  the  distribution  function  of  :i,  depending  on  the  value  r  of  the 
parameter  R.  Furthermore: 


cp^(r)  =  -  ^  G(|;r) 


is  the  "fiduical"  density  function  of  the  parameter  R  according  to  Fisher 


(3) 

[2] 


Hence,  C^(r)  may  be  regarded  as  a  complementary  fiducial  distribution  of  R  in 
which  the  fiducial  interval  is  equal  to  the  confidence  interval. 


{ 
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It  appears  that  (2)  will  be  true  for  a  general  parameter  9  whenever  the 
solution,  0(g),  of  G(g;0)  =  l«a,  for  fixed  a,  is  a  1-1  function  of  (See 

[3] 

Lehmann  ,  p.  80,  Corollary  3.)  However,  rather  than  appeal  to  this  lemma, 

(2)  will  be  demonstrated  by  direct  evaluation  for  the  particular  cases  studied. 
That  is,  the  confidence  relation  will  be  derived  from  a  pivotal  quantity  and 
then  the  distribution  function  G(g;r)  will  be  derived  directly  and  shown  equal 
to  C^(r). 

The  two  inferences,  a  best  estimate  and  a  confidence  relation,  will  now  be 
evaluated  under;  (i)  no  assumption  concerning  F^(t)  (ii)  the  assumption  that 

Fc(t)  =  exp(-t/0)^;  0  >  0,  k  >  0  (the  Weibull  distribution). 

2.  NO  ASSUMPTION  CONCERNING  F  (t) 

_ c 

Let  T^,...,T^  be  n  independent  random  variables  corresponding  to  a  random 

sample  of  size  n  from  the  distribution  F^(t).  Let  S  be  the  statistic  defined 

as:  "the  number  of  sample  values  which  exceed  t  .  "  Then  since  R  =  F  (t  )  = 

m  c  m 

P{T.  >  t  ),  the  well  known  binomial  confidence  relation  for  R  may  be  derived 
from  the  observed  values  s  of  S: 

s-1 

j=o 

and  it  is  noted  that  this  confidence  relation  is  the  distribution  function  of 
•S,  G(s;r),  as  per  equation  (2).  The  best  estimate  for  R  is  simply  the  success 
ratio: 


R  =  S/n 


(5) 
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It  is  of  interest;  in  connection  with  subsequent  developments  of  this 
paper,  that  the  relation  (4)  can  be  derived  by  assuming  F^(t)  continuous  and 
considering  where  here  indicates  the  order  statistic.  A  con¬ 

fidence  relation  for  the  parameter  R  .  =  F  (t  where  t  .  -  <  t  <  t  . .  is 
given  as  the  following  incomplete  beta  function^^^^: 


n-v*.-  N v*-l , 

X  \1"X)  dx 


(6) 


1  -  I  (n+l-v*;VVc) 


However,  by  choice  of  t^^^,  R  >  R^^  and  hence  a  confidence  relation  for  R  is 
given  as: 

C  (r)  >  1  -  I®(n+l-v*,v*) 

„  ('> 

.  I  -  Or3(l-r)"-J 

j=n+l-v* 

But  n+l-v*  =  s  and  hence: 

s-1 

c.  (r)  >  y  (5)r^(l-r)"'j  (8) 

j=o 

which  is  the  binomial  relation  (4). 

As  an  example  of  the  use  of  this  relation  suppose  that  the  following  failure 
times,  in  hours,  are  recorded  for  a  particular  system: 

20.2,  1.6,  3.5,  15.  7,  62.1,  19.9 
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Further  suppose  that  the  mission  time  of  this  system  is  2  hours.  We  have: 
n=6,  s=5  and  hence  the  best  estimate  of  R  is  R  =  5/6  =  ,833.  The  confidence 
relation  is: 


C^(r)  >  1  -  I®(s,n+l-s) 
=  1  -  1^(5. 2) 


(9) 


ID 

In  particular^  the  confidence  that  R>  .833  is  1  -  I  333(5^2)  =  1  -  .736  =  .  264. 
This  is  quite  low  and  thus  one  would  probably  want  to  assert  instead:  R>  .600 
with  confidence  1  -  I  3qq(5>2)  =  1  -  .233  =  .  767.  Note  that  one  is  virtually 

g 

certain  that  R>  .400  since  the  confidence  in  this  statement  is  1  -  I  ^qq(3^2)  = 
.960.  Thus^  .400  could  be  used  as  a  minimum  reliability  point  for  a  maximum 
cost  or  maximum  risk  study. 

In  the  above  example,  the  best  estimate  and  the  confidence  statements  seem 
overly  conservative.  This  is  because  a  great  deal  of  information  contained  in 
the  sample,  i. e. ,  the  magnitudes  of  the  failure  times,  is  not  utilized.  To 
utilize  such  information,  some  assumption  must  be  made  regarding  the  distribution 
of  time  to  failure.  This  is  done  in  the  sections  to  follow  where  it  is  assumed 
that  this  distribution  is  Weibull. 


3.  THE  WEIBULL  ASSUMPTION 

In  the  remainder  of  the  paper  it  will  be  assumed  that  F^(t)  is  Weibull: 
F^(t)  =  expC-t/e)*^;  0,k  >  0 


(10) 
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1 


This  distribution  is  well  suited  for  reliability  applications.  The  parameter  k 
indicates  the  wear-out  characteristics  of  the  system  involved.  For  k«l  (exponential) 
there  is  no  wear -out j  for  k  >  1^  wear -out  occurs;  and  for  k  <  1  there  is  negative 
wear-out^  i. e. ,  the  longer  a  system  remains  in  operation^  the  better  its  chances 
of  surviving  a  subsequent  time  interval.  These  statements  are  made  precise  by 
considering  the  value  of  the  conditional  density  function,  f(tlT  >  t),  at  t  =  t. 

This  is  known  as  the  hazard,  h(T),  and  in  the  Weibull  case  is: 

h(T)  =  (k/e^T*""^  (11) 

Thus  the  hazard  is  increasing,  constant,  or  decreasing  as  k  is  respectively 
greater,  equal,  or  less  than  one.  J 

In  what  is  to  follow,  it  will  be  assumed  that  the  value  of  k  is  known. 

Thus  these  results,  to  be  useful,  depend  on  empirical  or  theoretical  evaluations 
of  k  for  certain  classes  of  systems.  This  has  been  done,  for  example,  by 
Drenick^^^  who  has  shown  that  k=l  is  a  good  assumption  for  highly  complex 
systems. 

4.  AN  ORDER  STATISTIC  CONFIDENCE  RELATION 

Consider  the  pivotal  quantity:  A  =  (T^/0)^  where  T^  is  the  v—  order 
statistic  (v  arbitrary)  from  a  random  sample  of  size  n  taken  from  the  Weibull 
distribution  of  equation  (10).  The  distribution  of  A  may  be  found  to  be: 


H(X)  =  P(A  <  X) 

1 


nl 


(v-1) 1 (n-v)  I 


n-v,-  vV-1, 

X  (l~x)  dx 


exp(-X) 


(12) 
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Hence: 

H(X)  -  P(T^/0)‘‘  <  X} 

-  p(e  >  T /x^A) 

(13) 

-  P{exp(-t^/e)*^  >  expt-XCt^/T^)*^!} 

-  P(R  >  r) 

where: 

r  -  exp[-X(tyT^)‘']  (14) 

or: 

X  -  (.lnr)(T^/t^)*^  (15) 

and  therefore: 

P(R>  r)  -  H(X)  -  H[(-lnr)(Tyt^)‘']  (16) 

As  a  probability  statement^  this  Is  Interpreted  In  the  following  manner.  For 
fixed  OL,  the  random  variable  r  defined  as  the  solution  of: 

l-a  -  H[(-lnr)(Tyt^)*']  (17) 

Is  such  that:  ■  l-a>  all  R.  Thus^  to  obtain  the  confidence  relation 

Ic  Ic 

Ct«  (r)^  an  observed  value  t^  of  the  statistic  Is  substituted  in  (16): 
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“  HU-lnr)(t^/t^)  ] 


(18) 


-  ^  (n+l.v,v) 


Note  that  for  k=o  and  v=v*,  this  confidence  relation  reduces  to  the  binomial  one 
of  equation  (7).  Also^  to  verify  equation  (2)  in  this  context^  note  that  the 
Weibull  distribution  written  in  terms  of  the  value  r  of  the  parameter  R  ■  exp(-t^/0)^^ 
is: 


F  (t)  «  exp(-t/e)^  * 


(19) 


Therefore  the  distribution  of  T  may  be  found  as: 


x/t*" 

which^  if  one  lets  y  =  r  ^  becomes: 

1 


G(t 


V  r  nl  n-v^,  ^v-1. 

=j  jvTi)T(n-vn  y  (^-y> 

=  1  -  /t  -ik  (n+l-v,v) 

v/ 


(21) 


Therefore^  in  accordance  with  equation  (2)^  we  have: 


G(t;;;r)  -  C^j^(r) 

V 


(22) 
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As  an  example  of  the  use  of  the  relation  (18)^  consider  again  the  data  of 
Section  2.  Suppose  that  k  «  1.  2  and  we  desire  an  inference  based  on  the  third 
order  statistic:  t^  -  15.7.  We  have  (tj/t^)^  -  (15.7/2)^’^  -  (7.85)^'^  -  11.8 
and  therefore: 


'27.4")  ■  ‘  -  (23) 

As  a  comparison  with  the  earlier  example^  the  confidence  that  R  >  .833  is 

1  •  *  1  -  (4, 3)  »  1  -  .0022  ■  .9978.  For  the  exponential 

(.  833)  •  ' 

case,  i.  e. ,  k*l,  this  confidence  is  1  -  I  qc(^j3)  -  1  -  I  = 

(.833)'’®^  .239  ' 

1  -  .0320  -  .9680,  and  for  the  case  k«.8  we  obtain;  1  -  I^oq’7(^^3)  “ 

1  -  .1617  ■  .8383.  Note  that  these  three  confidence  values  are  significantly 
higher  than  the  value  of  .264  obtained  in  Section  2.  This  indicates  the  pro¬ 
found  effect  that  a  distributional  assumption  can  have  on  the  calculations. 


5.  A  SUFFICIENT  CONFIDENCE  REUTION 


The  Weibull  density  function  (minus  the  derivative  of  (19))  may  be  written 

rol 

to  indicate  its  membership  in  the  exponential  family^ 


f(t)  -  (-Inr^/^  (t/t 


■  (-Inr^/^)  (t/t^)*‘”^expt(lnr)  (t/ 


Therefore  the  statistic: 


(25) 
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U 

is  sufficient  for  R.  Consider  the  pivotal  quantity:  A  «  f/d  .  Its 
may  be  found  to  be  the  following  incomplete  gamma  functic.;!^^^: 
nX 

»  (X>/n,n-l) 


Hence: 

H(X)  «  <  X) 

"  p{e  > 

=»  P{exp(-t  /O)^  >  exp(-t^/j)} 
m  m 

=  P{R  >  r) 

where: 

r  -  exp(-t^X/f) 
or: 

X  -  (-Inr)  (f/t^) 
and  therefore: 

P{R  >  r)  -  H[(-lnr)(f/t^)l  =  H(X) 


distribution 


(26) 


(27) 


(28) 


(29) 


(30) 


where  this  probability  statement  is  Interpreted  as  in  equation  (16).  Thus,  to 
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obtain  the  confidence  relation  C  (r),  an  observed  value  ’I'  of  £  Is  substituted  In 


(30): 


C^(r)  -  H[(-lnr)(\|r/t^)] 


[(-lnr)(\|f/t^)  '/n,n-l] 


(31) 


Finally^  to  verify  equation  (2)^  the  distribution  of  £  may  be  found  as: 

^  [ (n/ t^) ( - Inr) -  /  k 
/  _n-l^nx/t„ 


G(t;r) 


(n-1) I 


■m  dx 


(32) 


Which^  if  one  lets  y  *  n(-lnr) (x/t^)^  becomes: 

n(-lnr) (t/t^) 

-  I^[(-lnr)(t/t^)  >^n,n-l] 
Therefore,  again  In  accordance  with  (2): 


(33) 


G(t;r)  -  C^(r) 


(34) 


As  an  example  of  the  use  of  the  relation  (31)^  consider  again  the  data  of 
Section  2  and  the  value  k  ■  la2.  We  have  ^  «  (20.2^*^  +  1.6^’^  +  3.5^’^  + 
15.7^'^  +  62.1^’^  +  19.9^'^)/6  -  41.45  and  therefore; 
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C^1^45(r)  -  f  [(-lnr)(41.45/2^-2)  sTe^S] 
«  I^[(-lnr)(44. 10),5] 


(35) 


The  confidence  that  R  >  .  833  is  if  [(-In  .  833) (44.  10) , 5]  =  I^[8.05,5]  »  .9999. 

For  the  exponential  case^  \|r  is  the  sample  mean^  20.5^  and  the  confidence  is 
I^[(-ln  . 833) (20.  5/2) -fe, 5]  =  I^[4.59,5]  =  .9674  and  for  the  case  k  s  . 8  we 
obtain  l^[(-ln  . 833) (10. 47/2' ®)  =  I^[2. 70,5]  -  .6472.  Comparing  these 

values;  .9999, .9674,  and  .6472  with  the  values  obtained  in  the  previous 
section:  .9978,  .9680,  and  .8383,  it  appears  that  C^(^)  more  sensitive  to 
the  distributional  assumption  (the  value  of  k)  than  is  C^^(r).  This  is  because 
C^(r),  being  sufficient,  utilizes  all  the  information  in  the  sample  concerning 
R,  whereas  C  ^(r)  does  not.  Therefore  C, (r)  should  be  used  for  the  data  con- 
sidered.  There  do  arise,  however,  situations  in  which  C^^(r)  is  superior  to 
C,(r)  and  these  are  discussed  in  the  next  section. 

6.  THE  USE  OF  THE  CONFIDENCE  RELATIONS 

As  pointed  out  above,  C^(i^)  Is  based  on  the  sufficient  statistic  ^  whereas 
C^k(0  is  based  on  T^  which  is  non- sufficient.  Also,  it  follows  from  a  corollary 
of  Lehmann  ([3],  p.  80,  Corollary  3)  that  the  confidence  bound,  r,  derived  from 
C^(r)  is  "uniformly  most  accurate.  "  Therefore  C^(r)  is  mathematically  superior 
to  However,  in  reliability  estimation  the  statictic  T^  has  a  great 

practical  advantage  over  the  statistic  which  in  some  cases  makes  C^^(r)  the 
superior  confidence  relation.  This  advantage  is  the  fact  that  to  obtain  T^, 
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only  V  systems  need  be  destroyed  but  to  obtain  all  systems  must  be  destroyed^ 
i.e. ^  all  failure  times  must  be  known.  Thus^  for  example^  In  a  life  test  In 
which  n  systems  are  placed  on  test  simultaneously^  the  v—  observed  failure  time 
Is  the  V—  order  statistic.  The  test  may  therefore  be  discontinued  after^  say^ 

one  failure^  and  the  relation  C  ^^(r)  used.  To  use  C  (r),  however^  the  test  must 

¥ 

be  continued  until  all  systems  have  failed. 

This  advantage  may  also  be  exploited  in  the  analysis  of  field  data  such  as 
the  data  used  in  the  preceding  examples.  Suppose^  for  example^  that  in  addition 
to  the  recorded  failure  times:  20. 2,  1. 6^  3. 5,  15. 1 ,  62. 1^  19. 9^  it  is  known 
that  3  systems  are  still  in  operation  and  each  has  lasted  longer  than  the  longest 
recorded  failure  time^  namely^  62. 1  hours.  The  above  failure  times^  when 
arranged  in  order^  then  represent  the  first  six  order  statistics  from  a  sample 
of  size  11.  It  therefore  appears  that  C^j^Cr)^  1  ^  based  on  n  *  11  will 

V 

be  more  accurate  than  based  on  n  «  6.  To  illustrate  the  difference  in 

values  obtained^  we  have  from  Section  3  that  for  k  -  .8  the  confidence  that 
R  >  .  833^  based  on  n  »  6  and  \|/  *  10. 47  is  .  6472.  However,  for  k  «  .  8  the 
confidence  that  R  >  .833^  based  on  n  ■  11  and  t^  *  15.  7  is  1  -  I  3gy(9^3)  = 

1  -  .0045  -  .9955. 

7.  A  BEST  ESTIMATE  FOR  R 

If  T  is  a  random  variable  having  a  Weibull  distribution  with  parameters  9 
and  k,  then  T^  is  a  random  variable  having  an  exponential  distribution  with 
mean  Q  .  This  fact  has  been  used  throughout  this  paper  and  it  yields  the 
solution  of  the  problem  of  a  best  estimate  for  R  as  an  ininedlate  extension  of 
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an  earlier  result  derived  by  the  author The  best  unbiased  estimate  for  R  Is 
the  conditional  expectation,  E(r|^}  where  R  Is  the  success  ratio  of  equation  (5) 
and  is  the  sufficient  (and  complete)  statistic  of  equation  (25).  This  estimate 
is: 


R*  =  E(r|E)  =  (1  -  t^/nj)”"^ 


(36) 


fC  / 

where  R*  =  0  if  J  is  interesting  to  compare  this  estimate  with  the 

maximum  likelihood  estimate^  R: 


R  *  exp(-t^/j) 


(37) 


It  is  noted  that  R*  R  as  n  becomes  large. 

Finally^  it  is  of  interest  in  connection  with  fiducial  theory  to  compare 

(36)  and  (37)  with  two  additional  estimates  of  R.  Recall  that  C  i^(r)  and  C  (r) 

t  \|r 

V  ^ 

are  equivalent  to  complementary  fiducial  distributions  for  R.  We  should  there* 
fore  expect  the  means  of  these  distributions  (which  are  random  variables)  to  be 
good  point  estimates  for  R.  These  are: 


X 

h  ^ 

^  o  V  tt 


V-l 

JL  (n-i) 
i*o 


J^[n.l+(t^T^)  ] 


(38) 


[oHtJ/I)] 


(39) 


Note  chat  R^  Is  sufficient  (since  It  Is  a  function  of  and  since  ^  It 
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possesses  the  desirable  asymptotic  properties  of  R«  Also^  It  can  be  shown  that 

/V  O  /v 

has  less  bias  than  R.  Thus  It  appears  that  R^  Is  superior  to  R^  though 
inferior  to  R*,  the  best  estimate.  The  estimate  R^^  on  the  other  hand,  is 
very  poor  since  it  is  non-suff icient  and  non-cons is tent  in  addition  to  being 
biased. 

The  values  of  these  four  estimates,  for  k  1  and  the  data  of  Section  2, 
are  given  for  comparison  below. 


R*  -  [1  -  2/(6) (20. 5)]^ 
«  (.9837)^  =  .921 


(40) 


R  =  exp(-2/20.  5) 

=  exp  (-.0975)  =■  .907 


(41) 


R^  -  (6)  (5)  (4)/(6+2/l5.  7)  (5+2/15.  7)  (4+2/15.  7) 

=  120/129.8  =  .925 

s  r_i_f 

‘‘2  “  L6+(2/20.  5)_ 

-  (.9845)®  -  .910 


(42) 


(43) 
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